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CHAPTER  I 
INTRODUCTION 


In  the  design  of  an  information  or  data-processing  unit>  there 
are  two  extremes  which  may  be  followed.  The  first  is  to  design 
enormous  versatility  (and  therefore  great  complexity)  into  the  data 
processing  unit.  The  other  extreme  is  to  design  a  data-processing 
unit  to  handle  only  a  restricted  class  of  input  signals  (thereby  re¬ 
ducing  complexity  and  increasing  data  handling  speed).  In  such  a  case 
the  sensor  must  be  adjusted  so  that  only  this  class  of  signals  is  present. 
A  typical  class  of  signals  might  consist  of  voltages  between  zero  and 
one  volt.  For  example,  if  the  sensor  is  an  optical  one,  then  for  overall 
accuracy,  the  sensor  output  must  be  relatively  independent  of  ambient 
light  conditions.  This  of  course  implies  an  automatic  control  of  ampli¬ 
fier  gain  or  lens  opening  so  that  the  signal  will  fall  between  prescribed 
bounds.  In  the  case  of  a  radar  system  when  one  changes  receiver  gain, 
one  should  also  modify  pulse  width  and  I.  F.  amplifier  pass  band  in 
order  to  make  optimum  usage  of  the  radar  system.  Otherwise  noise 
may  dominate  in  areas  of  small  return  or  resolution  may  be  impaired 
in  regions  of  large  return, 

In  general,  an  adaptive  control  system  is  needed  at  the  sensor 
to  maintain  the  sensor  output  within  allowable  limits  if  the  data- 
processing  unit  is  to  be  effective.  Before  such  adaptive  systems  can 
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be  adequately  designed  for  use  In  the  applications  mentioned  above^  it 
is  necessary  that  analysis  methods,  and  ultimately,  synthesis  methods, 
be  developed  for  these  systems.  The  remainder  of  this  report  contains 
the  development  of  analysis  methods  for  a  class  of  adaptive  control 
systems.  This  class  of  systems  is  versatile  enough  that  applications 
simila.r  to  the  one  above  may  be  realized.  A  relatively  simple  system 
is  used  as  an  example  throughout  this  report. 


CHAPTER  n 
ADAPTIVE  CONTROL 

What  is  Adaptive  Control? 

The  term  adaptive  control  has  been  defined  in  many  ways  by  many 
people.  Webster  defines  adaptive  as  showing  properties  of  making 
suitable:  fitting;  adjusting;  control  as  to  exercise  directing,  guiding, 
or  restraining  power  over,  or  any  device  which  performs  the  above.® 
Another  version  of  the  definition  is  a  system  which  can  determine  its 
performance  equations  and  the  effect  of  its  environment  in  sufficient 
detail  that  some  performance  criterion  shall  always  be  optimum  in 
spite  of  arbitrary  variations  in  the  effect  of  the  environment. 

Finally  an  adaptive  control  system  may  be  defined  as  a  control  sys¬ 
tem  which  is  inherently  capable  of  maintaining  a  desired  performance 
in  the  presence  of  a  changing  environment.^  There  are,  of  course, 
many  other  definitions,  each  of  which  is  correct  in  the  sense  that 
there  is  at  this  writing  no  accepted  standard.  Furthermore,  there 
exist  presently  many  names  for  these  systems;  adaptive,  self- 
optimizing,  self-adjusting,  and  supervisory  control  systems,  to  name 
a  few.  Of  these,  the  most  descriptive  seems  to  be  supervisory,  since 
that  term  best  describes  the  operation  of  adjusting  parameter  values 
according  to  a  performance  criterion.  The  most  popular,  however, 
seems  to  be  the  term  adaptive.  The  popularity  of  the  word  adaptive 
is  enhanced  to  some  extent  by  the  relatively  new  field  of  bionics  and 
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by  the  desire  of  some  to  identify  the  operation  of  this  type  of  system 
with  the  performance  of  certain  tasks  by  humans  in  which  the  human 
adapts  himself  to  a  varying  environment.  It  is  felt  that  this  identifi¬ 
cation  is  a  good  one;  it  has  been  the  policy  of  the  author  and  his 
associates  to  study  the  human  in  order  to  learn  from  his  remarkable 
adaptive  capabilities  how  to  construct  better  adaptive  control',  systems. 

The  definition  of  the  term  adaptive  control  appears  to  be  best 
stated  as  accombination  of  several  definitions.  That  is,  an  adaptive 
control  system  is  any  system  that  adjusts  its  operating  character¬ 
istics  or  interna.1  parameters  in  such  a  manner  that  some  performance 
criterion  is  optimized  in  the  presence  of  a  changing  environment. 

Here  the  term  environment  is  broadened  to  include  physical  environ¬ 
ment,  e. g,,  the  air  density  in  the  vicinity  of  an  airplane;  disturb¬ 
ances,  e,g,,  air  turbulence  in  the  vicinity  of  an  airplane;  and  a 
statistical  change  at  the  system  input,  e»g. ,  a  shift  in  the  mean 
frequency  of  Gaussian  noise  at  the  input. 

How  Does  Adaptive  Control  Work? 

There  are  several  modes  of  system  operation  that  fall  into  the 
broad  classification  of  adaptive  control.  As  stated  before,  however, 
all  types  of  operation  include  a  performance  criterion  which  is  to  be 
optimized.  One  approach  is  to  consider  the  system  from  a  transient 
response  point  of  view,  applying  a  test  signal  to  the  input  of  the 
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system.  Here  the  adjusted  system  is  given  a  step  or  impulse  input 
periodically,  and  its  output  is  measured  in  terms  of  error  squared, 
overshoot,  settling  time,  or  some  other  transient  response  measure, 
including  comparison  with  the  response  of  a  model  system.  Then, 
based  upon  this  measure,  the  system  is  adjusted  to  optimize  the 
criterion  (i .  e  . ,  minimize  settling  time) . 

Another  method  is  to  perturb  or  dither  a  parameter  and  sense 
the  effect  of  this  perturbation.  Again,  this  effect  can  be  measured  by 
comparing  the  output  of  the  adjusted  system  to  that  of  a  model  system 
and  adjusting  the  parameter  to  reduce  the  difference  (i.e,,  minimize 
the  square  of  the  error  between  the  two  outputs).  This  perturbation 
maybe  sinusoidal,  random,  step-wise  discontinuous,  etc. 

Examples 

Under  the  definition  previously  stated,  several  examples  of 
adaptive  control  systems  may  be  mentioned.  In  1955,  an  optimizing 
servomechanism  was  built  at  the  Ohio  State  University  which  could 
locate  extrema  on  a  slotted  line.’  In  1957,  the  University  of  Cali¬ 
fornia  reported  on  in-flight  evaluation  of  aerodynamic  parameters 
by  means  of  programmed  disturbances.**^  In  l9f>0,  a  system  similar 

to  the  one  analyzed  herein  was  built  at  the  Ohio  State  University  to 

11 

measure  parameters  of  the  human  in  a  tracking  task.  Here,  the 
parameter  was  varied  sinusoidally.  Certain  industries,  the 
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petroleum  industries  specifically,  are  using  adaptive  control  systems 
in  their  refineries  to  optimize  system  operation  in  order  to  maxi¬ 
mize  dollars  profit.'  Thus  it  is  not  necessary  that  a  system  variable 
in  the  ordinary  sense  be  used  as  a  performance  criterion. 

When  is  Adaptive  Control  Advantageous  ? 

This  question  may  appear  trivial,  since  it  would  seem  that  in 
most  applications  involving  control  systems,  the  most  sophisticated 
system  (i.e.,  the  adaptive  system)  should  give  the  beet  performance. 
This,  however,  is  not  the  case.  If,  for  example,  the  input  to  a  sys¬ 
tem  is  a  known  function  of  time,  the  best  response  is  found  when 
using  a  cam  arrangement  between  input  and  output.  Here  there  is 
zero  error.  If  the  input  is  random  but  stationary,  then  the  best  sys¬ 
tem  is  a  linear  one^^  providing  the  criterion  for  the  system  response 
falls  into  the  usual  classification.  That  is,  the  output  must  be  a 
linear  function  of  the  input,  and  the  performance  criterion  must  be 
minimum  rms  error.  If,  however,  the  environ’ment (in  the  broad 
sense)  changes  with  time,  then,  and  only  then,  can  an  adaptive 
control  system  be  used  to  advantage. 

Nature  of  the  Adaptive  Control 
System  in  this  Study 

The  system  considered  in  this  paper  is  the  one  previously 
described  in  terms  of  parameter  dither  where,  in  this  case, 
sinusoidal  dither  is  used.  In  particular,  two  systems  in  this  class 
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are  considered.  The  first  system  considered  is  the  "slow"  system. 
The  term  slow  is  used  for  the  following  reasons:  the  dither  frequency 
is  much  smaller  than  the  mean  frequencies  of  the  input  signal  and 
the  responses  of  the  adjusted  and  model  systems  are  fast  compared 
with  the  adaptive  loop,  so  that  the  primary  system  can  be  considered 
to  be  in  the  steady  state  at  all  times  during  the  adaption  process.  In 
the  second  case,  the  "fast"  system  is  so  named  because  the  dither 
frequency  is  large  with  respect  to  the  mean  frequencies  of  the  input, 
and  the  response  of  the  adjusted  system  is  dependent  upon  past  pa¬ 
rameter  variations.  The  system  operation  is  designed  as  follows: 

The  difference  in  outputs  of  the  model  and  adjusted  system  is  squared 
and  forced  to  zero.  This  is  the  performance  criterion  for  both  the 
slow  and  fast  systems.  To  effect  this  forcing  to  zero,  the  average 
value  of  the  adjusted  parameter  is  driven  in  a  direction  so  that  the 
error  squared  is  decreased.  The  operation  of  the  two  types  is 
analyzed  for  the  case  of  an  input  which  is  random  in  nature.  The 

input  is  obtained  by  filtering  a  square  wave  with  Poisson-distributed 
.  13 

zero  crossings  .  The  mean  frequency  of  the  inpat  is  near  one  cycle 
per  second.  The  remainder  of  this  paper  contains  the  analyses 
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CHAPTER  Ill 


THE  SLOW  SYSTEM  WITH  SMALL  INITIAL  ERROR 


In  this  chapter,  the  operation  of  the  slow  system,  shown  in 
Figure  1,  will  be  analyzed.  The  slow  system  is  characterized  by  the 
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Fig.  1.  Block  diagram  of  the  slow  system. 


fact  that  the  parameter  variation  is  sufficiently  slow  that  the  adjusted 
system  is  essentially  in  the  steady  state  during  the  adaption  process. 
The  solution  here  is  presented  for  the  case  in  which  the  parameter 
a^,  the  steady  state  gain  of  the  adjusted  system  is  varied.  This 
example  is  selected  as  being  representative  of  this  type  of  system, 
although  any  of  the  system  parameters  can  be  adjusted  similarly. 
Because  of  the  nature  of  the  slow  system,  the  results  here  are  de¬ 
terministic  rather  than  probabalistic  since  the  solution  has  been 
derived  on  the  basis  of  expected  values  of  the  signal  in  the  adaptive 
loop,  neglecting  all  statistical  fluctuations. 
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In  Figure  1,  GQ(jw)  is  the  transfer  function  of  the  model  sys¬ 
tem  while  G(jw)  is  the  transfer  function  of  the  system  being  adjusted. 
Consider  the  model  system  to  have  the  transfer  function 

1 

G  (jcj)  = - - - ^ - 

°  -a2  u  +  j  ai  w  +  a^ 

where  aj's  are  constants.  If  an  adaptive  system  is  operated  in 
parallel  with  the  model  system,  the  difference  between  the  system 
outputs,  c,  provides  a  signal  suitable  for  the  adaptive  system's 
operating  criterion.  The  transfer  function  of  the  adjusted  system 
has  the  form 

G(jQ)  - - r - - 

-a2  u  +  j  ai  w  +  Sq  +  6(t)  +  bj  cos  wj  t 

where  the  a^'s  are  the  same  as  those  in  Gq,  6(t)  is  a  small  deviation 
about  a^,  and  bi  cosuit  is  a  dither  signal  added  to  the  terms  aQ+5(t). 
The  systems  will  be  driven  by  x(t),  a  random  function  of  time  having 
the  form^ 

x(t)  =  ^  a( 

[n] 

where  the  n's  are  irrational  numbers  so  that  one  and  only  one  exists 
between  two  adjacent  integers. 
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The  dither  frequency  ui  is  much  less  than  the  mean  frequency 
of  the  input  signal  x(t)  in  the  so-called  "slow"  system.  The  slow 
system  is  characterized  by  another  condition^  namely,  that  the 
dither  frequency  is  low  with  respect  to  the  average  si/^nal  frequency 
and  it  may  be  assumed  that  the  only  signal  passing  through  the  phase 
sensitive  detector  is  a  d-c  term  corresponding  to  the  magnitude  of 
the  error  squared  term  at  the  dither  frequency.  The  statistical 
type  fluctuations  at  the  output  of  this  detector  are  attenuated  by  the 
low-pass  filter  following  this  detector.  As  shown  in  Figure  1,  the 
difference  in  output  of  the  two  systems,  £,  is  squared  and  passed 
through  the  phase  sensitive  detector.  The  component  of  the  squared 
signal  at  frequency  ui  ,  the  dither  frequency,  is  denoted  as  .  The 
criterion  assumed  for  the  adaptive  process  is  that  of  adjusting  a^  + 
6(t)  so  as  to  force  to  zero.  The  technique  for  analyzing  the 
operation  of  this  system  is  represented  by  the  block  diagram  in 
Figure  2 .  This  technique  is  an  expansion  of  the  system  shown  in 
Figure  1 .  One  approximation  is  introduced  in  that  components  at 
frequency  u  t  Zwj  and  higher  are  neglected  as  indicated.  The 


’*'Here  mean  frequency  is  defined  in  the  sense 

where  is  the  power  density 

spectrum  of  the  input. 
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modulator  blocks  ^  shown  in  Figure  2  introduce  the  time-varying 
portion  of  the  total  signal  due  to  the  dithering  of  the  parameter  a^.  The 
total  output  is  the  sum  of  the  outputs  labeled  Yi  ,  Y2+  >  and  Y2-  as 
shown  in  Figure  2 . 


Fig.  2.  Alternative  representation  of  the 
system  shown  in  Figure  1. 


Assuming  that  the  input  x  contains  only  the  frequency  w,  it  may  be 

represented  in  complex  form  as  X(jw).  Then  the  adaptive  system  may 

be  represented  as  shown  in  Figure  2.  The  modulator  blocks  multiply 

their  input  signals  by  bi(e‘^**^*^  +  e  ■^***^  ^)  where  bi  is  small.  Again, 

♦♦ 

capital  letters  are  used  to  represent  complex  quantities. 


♦ 

The  following  subscript  convention  is  used:  a  plus  (+)  subscript  indi¬ 
cates  that  the  term  is  a  function  of  its  regular  argument  +(oi  .  E.  g., 
Y2+  =  Y2  (w  +  wi  ) .  The  negative  sign  means  the  opposite. 

The  complex  notation  used  herein  is  written  so  that  the  physical 
signal  or  signal  component  x(t)  is  obtained  from  the  complex  represent¬ 
ation  X  of  the  signal  as  follows; 

x(t)  =  X  +  X*  e"-’'*'^  . 
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From  Figure  2,  the  relation  between  E  and  X  may  be  written  by 
inspection. 

(3-1)  E  =  X  +  E  bi  2  G  (j«)  [  G  (j  (w  +  u>i  ))  +  G  (j  («-  wi  ))  ] 


Rearranging  terms  in  Eq.  (3-1), 


(3-2) 


E  = 


X _ 

1  -  bi^  G  (G^.  +  G.) 


Now  writing  Yj  ,  ,  and  Yj.  in  terms  of  the  input  and  the  gains. 


(3-3) 


Yi  =  EG  = - 

1  -  bi 


XG _ 

G  (G^  +  G  J 


(3-4) 


(3-5) 


Ya+  =  Yi  bi 


G+ 


e 


bi  X  GG+  e^"^  ^ 

1  -  bi*  G(G+  +  G.) 


Ya.  =  Yj  bi  G.  e 


^  bi  X  GG_  e 


-  M  t 


1  -  bi  G  (G+  +  G.) 


If  the  same  type  of  notation  is  used  the  output  of  the  model  system  may 
be  written 


(3-6)  Y  =  X  GqO)  =  X  G^ 

m 

In  terms  of  Eqs .  (3-3)  through  (3-6) 

(3-7)  e  =  Yi  +  Ya+  +  Ya.  +  (-  Y^^) 
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or 


(3-8) 


Xl  G  +  bi  GG+  ^  +  bi  GG.  e"**"*  *  -  G^tl  -  bi  *  G  (  G^  +  G. ))] 

1  -  bi^  G  (G+  +  G.) 


* 

Now  assuming  that  terms  involving  bi  *  may  be  neglected^  Eq.  (3-8) 
reduces  to 


(3-9)  e  =  X  [  G  -  Gq  +  bi  GG+  e^*^*  *  +  bi  GG. 


It  can  be  seen  from  Figure  1  that  the  signal  now  passes  through  the 
squaring  device  and  then  the  phase  sensitive  detector.  These  two  phys¬ 
ical  operations  correspond  mathematically  to  squaring  e  and  retaining 
only  those  terms  at  frequency  wi  .  Prior  to  the  squarings  however^  the 
expression  for  e  will  be  modified  to  represent  the  signal  due  to  the 
random  input  x,  and  then  simplified.  In  terms  of  the  random  input 
variable  x. 


jn^t. 


(3-10)  *  ~  A  *  [  G(jni^)-G,j(jnA)  +  bj  G(jnA)G{j(nA +wi  ))e 

[nl 


Mt 


+  bi  G  (  j  n A )  G  (j  (nA  -  <*>1 ))  e  *  ] 


Here  €  is  the  real  signal. 

Henceforth  the  brackets  will  be  omitted  from  [n]  with  the 


* 

This  corresponds  to  opening  the  feedback  loops  shown  in  Figure  2. 
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understanding  that  when  n  is  used  as  an  index,  it  refers  to  the  nearest 
integer  to  n. 

Consider  for  the  moment  only  the  term  G-Gq  from  Eq.  (3-10) 

(3-11)  G-G  = _ I _ _ I _ 

O  5 

-az  +  a^  +  j  ai  w  +  6  -az  +  a^  +  j  ai  u 

If  one  makes  the  approximation  _ ? _  =1-6  when  6  «  1,  and  since  6 

1+6 

is  a  small  deviation  of  a^  about  equilibrium, 

(3-12)  G-G^  =  -  6  Go'" 

The  conditions  for  which  Eq.  (3-12)  is  valid  are  described  in  Appendix 
II.  Now  consider  the  product  G(jw)  G(j(w  ±  ) ) .  This  product  is 

written  at  length  as 

(3-13)  G(jw)  G(j(«  *«,))  =  - 1 -  X 

-az  w*  +  a^j  +  j  ai  u>  +  6 

X _ -  . 

-az  (w  ±  wi  )Z  +  +  j  ai  (w*  Wi  )  +  6 

If  one  UBCB  the  same  simplification  as  above, 

(3-14)  G(ja,)  G(j  (w  ±  )  )  =  Go  (j«)(l  -  6  G^(j«)  )  X 


^  Gq  ^ “1  ) )  (1  “  6  GqI  j  “1  ) ) ) 
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Now  if  terms  in  6^  are  dropped, 

(3-15)  G(ju)  G(j  (w  +  ) )  =  Gq  (j<o)  Go  (j  (0)  ±  uj  )  )  X 

X  (1  -  6  (Go(jw)  +  Go  (j  (w±  wi))  )  ). 
Substituting  Eqs .  (3-12)  and  (3-14)  into  Eq.  (3-10)  results  in 


(3-16)  €=  ^  a^e^^^Vs  Go'  +  bi  G^G^^(1.6(Go  +  G^^))e^“'^ 
n 

+  bi  GoGo_  (1-6  (Go+  Go_) )  ^  ] 

Now  Eq.  (3-l6)  will  be  squared  so  as  to  retain  only  those  terms  at 
frequency  wi  .  Furthermore,  in  squaring  the  summation,  only  terms 

of  the  form  a^a _ ^  where  n  =  -m  will  be  retained.  Hence, 

in  each  product  above,  the  index  n  will  be  used  in  the  first  term  of 
each  product  and  -n  with  the  second.  Finally,  all  terms  in  6^  will  be 
dropped.  This  part  of  the  error  squared  will  be  labeled  ^  . 


(3-17)  o  =  ^  (-5  ^ 


n 

-  n 

°o( 

-  j(nA  -Wi  )J 

e’’^^  ^  +  bi  Go(-jnA) 

-  j(nA  +wi  )j 

Go(-jnA) 
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(3-18)  €2 


=  I  (-  '  l°ol'){ 

n 


K 

^O-  ® 


*  -jwi  t 
+  G  G„ .  e 

O  OT 


! 


Now  if  the  discrete  sum  is  replaced  by  an  infinite  integral^  ^  may 


be  written  as 


I 


(3-19)  e2  =-6bi  \  «(«)|Gol  <G_G_  e*'  *  +  G^  G..  e 


$  (w)  dw  is  the  continuous  equivalent  of  the  infinite  sum  L  a  ^  .  Here 

wi  +A 

the  power  contained  in  one  term  a^^^  is  equal  to  ^  $  (w)  dco  where 


th  * 

the  interval  from  wi  to  oji  +A  includes  the  m  term,  namely,  mA  in 

the  infinite  sum.  If  it  is  recalled  that  this  signal  is  passed  through  the 

iwi  t 

phase  sensitive  detector,  the  term  e  may  be  dropped  from  each 

factor  in  Eq.  (3-19).  This  represents  taking  the  magnitude  of  the  in- 
phase  term,  and  will  be  indicated  by  the  subscript  1  on  .  A 
description  of  the  operation  of  the  phase  sensitive  detector  is  given  in 
Appendix  I. 

Note  that  the  term  in  the  brackets  in  Eq.  (3-19)  is  real,  after  the 
e  ^  terms  are  dropped.  Furthermore,  it  is  equal  to  twice  the  real 
part  of  the  first  term.  If  one  uses  this,  as  well  as  further  simplifica¬ 
tions,  the  integral  in  Eq.  (3-19)  can  be  reduced. 


(3-20)  2  Re  (G^  G^.  )  =  2  Re 


■ 


1 


1 


a2  w?+aQ+jai  «  -&z  (w^wj  )^iaQ+jai  (ux-wi  ) 


}. 
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Noting  that  wx  «  u,  the  above  expression  may  be  written  as 


(3-21)  2  Re  (GoG^_  )  =  2  Re  ^  G, 


_ 1 _ I 

/  °  -a.z  w*  +  a^j-jaiw  +  D  J 


where  D  s  2  az  ‘*>«i  -  az  ui  *  +  j  aiwi  .  Thus 


(3-22)  2  Re  (G^G^.*)  =  2  Re  |  G^G^*  (1 


{■ 


DO.",  j 


=  2  Re^G  G^ 

o  o 


1  -  (2az  wwi  -  az  ci>x  +  j 


j  ax  «x )  Gq  j| 


Consider  the  following: 


(3-23)  Re 


=  Re 


jl  -  (2az  wwi  -  az  wx  ^  +  j  ai  cox  )  G^  j 

2  az  cocjx  -  az  «x  *  +  j  ax  cox  T 
-  az  CO*  +  a^  j  ax  CO  J 


t 


(2  az  cou)x  -  az  u)x^  )  (-az  +  ap)-  (ax  m 
(-  az  «*  +  a^,)*  +  (axw)* 


^)| 


Since  the  integral  has  limits  -  eo  to  «>  ,  the  terms  in  odd  powers  of  co 
contribute  nothing;  Thus  Eq.  (3-19)  becomes 


SO 

(3-24)  -  6bx  J  4  (CO)  \C^\* 


1  + 


az  wx  *  (-az  +  ao) 
(-az  w*  +  a^)*  +  (axco)* 


db>  . 


With  the  assumption  that  §  (w)  =  ""p;  >  the  integral  can  be 


evaluated . 
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00 

r  f  1  1  \ 

1  1 

» 1 

-az  u)2  +aQ+  jaiw  az  w‘+  a^;  jai  w 

1  +  ^ 


2  2  3,  2 

-az  cji  ^  u  +  a.  a.2  wi; 


[  (-az  +  a^f  jaiw)  (-az  +  a^  -  j  ai  w  ) 


du 


Using  the  integral  table  in  Reference  3,  the  above  expression  reduces 
to 

(3-26)  1  =  -  6bi  (I5  +  I7  )  ; 

2 

and  if  terms  involving  wj  are  neglected^ 

(3-27)  €*1  =  -  6bi  I5  . 

This  may  be  interpreted  as  follows:  The  adaptive  system  will  tend  to 
reduce  to  zero;  when  this  is  accomplished^  6  above  must  be  zero; 
thus  the  adaptive  system  becomes  identical  with  the  model  system. 

The  next  question  which  arises  is  that  of  determining  the  form  of 
(  ^  (f)  )  the  case  where  some  or  all  of  the  foregoing  approxima¬ 
tions  are  not  made . 

As  can  be  seen  from  £q.  (3-16)  and  those  equations  immediately 
preceding  ,  if  no  approximations  are  made  initially,  the  final  form  of 
the  term  €^i  will  be 


=  Cl  6  +  Cz  6% 
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where  the  Q 's  are  constants  and  «  Cj  .  Suppose  €3  =04  =  .  .  .  = 

Cn  =  0 .  Then  =  Ci  6  +  C2  6*  . 

Setting  €*i  =0  gives 

Cl 

6=0  and  6  =  -  — 

C2 

Since  C2  «  Cj  ,  this  implies  that  the  error  in  a^  is  very  large. 
But  this  cannot  be^  since  the  previous  analysis  depends  upon  5  being 
small.  Furthermore,  if  the  adaptive  system  is  stable  in  the  vicinity  of 
equilibrium  or  6  =  0,  any  deviation  from  zero  will  tend  to  return  to 
zero.  Once  the  expression  for  is  in  the  form  of  Eq.  (3-27),  it  is 
possible  to  conduct  a  stability  analysis  for  the  system  by  using  classical 
nonlinear  methods,  such  as  the  small  signal  theory  for  the  system 
near  equilibrium  or  other  applicable  methods.  The  behavior  of  the 
system  for  large  initial  values  of  5  (t)  will  be  considered  in  the  next 


chapter. 


CHAPTER  IV 


THE  SLOW  SYSTEM  WITH  LARGE  INITIAL  ERROR 


The  previous  analysis  of  the  slow  system  has  been  done  with  the 
assumption  that  the  initial  value  aofc.:  6(t)  is  small  enough  for  terms 
in  6^  to  be  neglected.  As  indicated  at  the  end  of  Chapter  III^  the 
system  should  be  studied  for  large  values  of  6^  or  values  away  from 
equilibrium  in  order  to  determine  the  conditions  for  instability^  if  any 
exist.  The  error >  8  before  any  approximations  are  made,  can  be 
written  as  Eq.  (3-8)  in  complex  form. 


(4-1)  e  = 


r  t  JU)1  t  ,  , 

X[G+bi  GG+e  +  bi  GG_e  -  G^  (1+ bi  ^  G(G^  +  GJ  )  ] 

1  -  bi*  G  (G++  G.) 


Again,  assuming  that  bi  is  «  1  and  bi  |g|  in  all  cases  is  smaller  than 
unity,  the  following  approximation  can  be  made. 

(4-2)  8  =  X  [  G  +  bi  GG+  e-^*  V  bi  GG.  e’’’"*  ^  ] 


At  this  point  it  is  desirable  to  assume  values  for  the  constants  in 
the  gain  expressions  and  evaluate  the  error  €  .  Inserting  the  summa¬ 
tion  expression  for  x(t),  and  representing  (n  A)  in  the  gain  expressions 
by  cj  ,  e  becomes 
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(4-3)  e 


=  y  a.  , 

[  nl  t'*' 


jaiw+6  -azw  +aQ  +  jaiw 


+  bi  r - 1 _ _ I -  6“*“^  * 

1  -az  u*  +  aQ+  jai  w  +6  -az  (w  +  wi  )*+a^+  jai  (w  +wi  )  +  6 


+  bi 


1 


-az  w  +  a-  +  jai  w+6  -az  (w  -  wi  )^+  a  +  jai  (w-ui  )+6j 


])- jwi  t 

f 


The  brackets  on  the  index  [  n]  will  again  be  pmitted.  At  this  pointy  let 


aj  =  ai  =  a^  =  1. 


^  ^n 


jnAt 


~<ji‘  +  1  +  jw  +  6  -(j/  +  1  +  jw 


+  bi 


jWit 


-«*  +  1  +  j«  +  6  -(w  +  wi  )*  +  1  +  j  («  +  wi )  +  6 


+  bi 


_ 1 

-w*  +  1  +  jw  +  6 


_ 1 _ 

-(w  -  wi  )*  +  1  +  j  (w  -  wi  )+  6 


To  simplify  the  analysis, it  is  expedient  to  square  e  at  this  time, 
neglecting  all  terms  at  frequencies  other  than  wi  .  Note  that  in  the 
squaring  operation,  the  right-hand  member  of  each  product  will  appear 
as  complex  conjugates  as  in  Chapter  III.  Again,  this  term  will  be 


denoted  by  the  subscript  1. 
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(4-7)  €%  = 


_ -  6bi 

1+6  +ja)  1^  {-«H  1  +  jcj)(-(co  +  «i  )*  +  1+  6  -  j  (w  + wi  ) ) 


-  6bi 


-co^  +  1  +  6  +  jw  I  ^  ( -0)^  +  1  +  j  w)(  -  (to  -  u)i  )^  +  1  +6  -  j  (w  -  (Ji  )  ) 


(4-8)  6 


(-6bi) 


1+6  -  j  w 


^ - — 

I  (-0)  +  l  +  joj)(-(ci)  +  u)i)^  +  l+  6  -  j(w  + 


wi  )  ) 


(-«*  +  1  +  jw)(  -  (w  -  co  i  )^  +  1  +  6  -  j  (w  -  Wi  )  ) 


It  will  be  assumed  in  the  following  equations  that  wx  is  sufficiently 
small  for  «i  ^  terms  to  be  neglected. 

Expanding  the  fractions  in  brackets  and  combining  gives 


|(.«*  + 


1  +  jw)(-w*  -2  ojwi  +  1  +  6  -  jw  -  jwi  ) 


- ^ - 1 

+  1  +  jw)(-w*  +  2  +  1  +  6  -  jw  +  jwi  )  j 
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Factoring  out 


(-w^  +  1  -  jw) 


(4-9)  Brackets 


+  1  +  ju)  I  I  1  + 


1 


2  /  ■,  ,  ^  ^ 


-  CO  +  1  -  jco 


-co^  +  1  + 


6  +  2  (jjwi  +  j  u)i ' 
^  ^  +  1  -  jlO  I 


Upon  rewriting  €^i  ,  one  can  write  Eq.  (4-9)  as 


(4-10)  €^1  =  )  a  " 


6  bi 


n 


n 


+  1  +  j«  I  ^  6-2  -  j  u>j 

1  +  ■> 


■«  +  1  -  jw 


) 


6  +  2  ucoj  +  j  Wj 


1  + 


-  +  1  -  jcj 


If  the  fractions  in  the  brackets  are  rationalized. 


-w  +  1  -  jO) 


-w^  +  1  -  jw 


-00^  +  1  -  jw  +  6  -  2  wwi  -  jwi  -w^  +  l-jw  +  6+  2  wui  +  jwi 

f 

( +  1  -  jw)  (-w^  +  l-jw+6  -w^  +  l-jw  +  6) 


—  > 


^  (-w^  +  l-jw  +  6-  2  wwi  -  jwi  )(-w^  +  l-jw+6  +  2  wwj  +  jwj  )  J 


(-w^  +  1  -  jw)  2  (-w^  +  1  -  jw  +  6  ) 


^(-w^  +  l-jw  +  6)^  -  (2  wwi  +  jwi  ) 


-) 
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Therefore 


(4-11) 


-  6  bi 

-0)2  +  1  +  jO)|^ 


I 


( -o)  +  1  -  ju))2(-o)^  +  1  -  jo)  +  6) 

(-0)2  +  1  —  jo)  +  6  )^  -  (2o)0)x  +  jo)j  ) 


If  0)1  «  0)  ,  the  terms  in  o)i 

average 


the  others  in  the  denominator  of  the 


can  be  neglected  with  respect  to 
expression  in  brackets^ 


(4-12) 


-  2  6  bi 

-0)^  +  1  +  j0)|* 


Note  that  this  reduces  to  the  expression  derived  in  the  previous  chapter 
when  the  approximation  of  6  small  is  used  if  the  approximation  of 
neglecting  o)i  ^  is  applied  to  Eq.  (3-20)  and  those  that  follow. 

Replacing  the  discrete  summation  by  the  equivalent  continuous 
form,  Eq.  (4-12)  may  be  written 


(4-13)  €*i 


2  6  bi  f  *(o)) - 

iw  I  jy  I  * 


-0)2  +  1  -  jO) 

^-o)*  +  1  -  jw  +  6 


This  may  also  be  evaluated  by  using  the  technique  mentioned  in  the 
previous  chapter.  In  this  case,  however,  the  6  term  appears  in  the 
denominator  and  it  must  be  expanded  in  order  to  see  how  the  function 
behaves  in  terms  of  6.  First,  one  must  rationalize  the  expression  in 


Eq.  (4-13)  above . 
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(4.14,  .^=.26b.  f—iSH! - 

J  I-U)^  +  1  +  ju>|^  (-W*  +  1  +  6)*  +  w* 


(4-15)  €*1  =  -  26bi  y 


p  +  jw  P  -  jw  (-W*  +l  +  ja))2  (-u)*+  l-j«)* 


cj  -(2-|-6)(o^-6j(o  +  l+  6 _ 

(-00*  +  1  +  6  +  joo)(-to^  +  1  +  6  -  jw) 


doo 


The  format  of  the  integral  as  given  in  Reference  3  is 


(4-16) 


i  *> 


-ioo 


C  8^-1 + 
n-1 


+ 


c 

o 


d  8*^  4  •  •  .  +  d 
n  o 


2 


ds  . 


The  terme  in  the  expreesion  found  in  Reference  3  are  equated  to 
the  terms  of  Eq.  (4-15)  as  shown  in  Table  I  . 


TABLE  I 

EVALUATION  OF  TERMS 


dy 

=  1 

df, 

=  +  (3  +P) 

ds 

=  +  (6 

+  3P  +  6) 

d4 

=  (7  + 

6P  +  2  6  +  P6) 

ds 

=  +  (6 

+  7P  +  36  +  2P6) 

dz 

=  (3  + 

6p  +  26  +  3P6  ) 

di 

=  (1  + 

3P  +  6  +  2P6  ) 

do 

=  P  (1 

+  6) 

2c4  Co  -  2c3Ci  +  C2  ^  =  1 

2c2  Co  -  Cl  2  =  2  +  6 

c  2  =1+6 
o 
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The  important  feature  is  not  the  exact  expression  for  but 
rather  the  form  of  the  expression  in  terms  of  6  , 

The  data  in  Table  2  show  the  highest  and  lowest  power  of  6  in  each 
term  of  the  evaluation  in  I?  .. 


TABLE  2 


POWERS  OF  6  IN  NUMERATOR  AND  DENOMINATOR 


Term 


Highest  power  of  6  Lowest  power  of  6 


mi  4 

mz  4 

m3  4 

m4  4 

ms  4 

ms  4 

ms  5 

(ci^  -  2ci  C3  +  2cqC4  )  ms  5 

A  7  6 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


Then,  the  form  of  e^i  becomes 


bi6|ko  +  ki6+k2  6^  +  k3  6*+k46^+k56® 
(4-17)  cS  =  - ^ 

Cq  +  Cl  6  +  cz  62  +  C3  6*  +  C4  6*  +  C5  6®+  cs  6^ 


where  the  c^  's  and  k^'s  are  constants.  Thus,  for  6  «  I,  as  in 
Chapter  III,  e^i  becomes  a  linear  function  of  6  ;  while  for  6  large,  so 
that  6®  »  6*,  e2j  becomes  essentially  independent  of  6.  Again,  as  in 
Chapter  III,  this  form  for  is  suited  to  doing  a  stability  analysis 
using  conventional  nonlinear  techniques. 


CHAPTER  V 


THE  FAST  SYSTEM  WITH  SMALL  INITIAL  ERROR 

One  of  the  goals  in  every  analysis  of  an  adaptive  control  system 
is  the  determination  of  the  variation  of  the  adjusted  parameter  about 
its  optimum  value.  It  is  tempting  in  the  study  of  these  variations 
simply  to  approximate  the  spectrum  at  the  output  of  the  criterion 
detector  on  the  basis  that  the  adaptive  or  supervisory  loop  is  opened 
and  on  the  assumption  that  no  parameter  variations  occur.  This  as¬ 
sumption,  although  it  is  often  valid  as  the  first  step  of  an  iterative 
determination  of  nonlinear  system  characteristics,  often  leads  to  a 
contradiction  in  adaptive  system  analysis  which  must  be  resolved. 

This  contradiction  arises  as  follows:  it  is  assumed  that  the  adaptive 
process  adjusts  itself  so  that  the  average  value  of  the  parameter 
error  is  zero  or  at  least  near  zero.  Yet  the  spectrum  of  the  fluctua¬ 
tion  of  this  parameter  about  its  average  value  (called  hunting  loss)  , 
if  calculated  on  the  basis  of  the  assumption  just  outlined,  may  well  be 
infinite  at  zero  frequency  indicating  not  only  a  large  and  very  slow  . 
variation  of  the  parameter  about  its  average  value,  but  also  the 
possibility  of  a  large  average  deviation  from  the  desired  value.  This 
apparent  contradiction  cannot  be  resolved  by  successive  iterations  and 
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it  must  be  concluded  either  that  the  system  does  not  adapts  or  that  the 

* 

methodology  employed  has  limitations  . 

The  latter  conclusion  is  the  case.  In  this  chapter^  the  assumptioiu 
and  constraints  which  defined  the  slow  system  will  be  dropped  and  a 
technique  will  be  developed  which  will  allow  the  determination  of  the 
spectrum  of  the  signals  in  the  supervisory  section  of  the  adaptive 
system  under  consideration.  The  same  technique  leads  to  a  represen¬ 
tation  which  can  be  used  to  determine  the  stability  of  the  adaptive 
system . 

In  this  chapter^  an  analysis  of  the  fast  system  will  be  made  .  The 
input  to  the  system  is  again  the  random  function  of  time  given  by 

(5-1)  ^[n] 

[n] 

♦♦ 

where  n  is  almost  but  not  quite  an  integer  and  [n]  is  the  nearest 
integer.  The  block  diagram  of  this  system  is  shown  in  Figure  3.  The 
analysis  will  be  carried  out  on  the  basis  of  observing  only  one  fre  - 
quency  component  of  the  total  signal  as  it  traverses  the  system.  If  the 


♦ 

If  the  transfer  function  of  the  adaptive  loop  does  not  have  a  pole 
or  poles  on  the  imaginary  axis,  the  iterative  technique  mentioned 
above  may  be  satisfactory. 

♦♦ 

As  in  earlier  chapters,  the  brackets  on  the  indices  will  be  omitted. 
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expression  for  one  compoiient  can  be  developed  ,  then  the  expression 
for  the  total  signal  may  be  found  by  generalizing  the  procedure  for  all 
frequencies  present.  Before  the  mathematical  analysis  of  this  system 
is  made,  a  description  of  the  method  of  analysis  will  be  given  in  order 
to  justify  this  approach  to  the  problem  . 

In  this  analysis,  the  system  is  assumed  to  be  at  equilibrium  so 
that  the  integrator  output  has  an  average  value  of  zero.  Note  that  the 
model  system  and  the  adjusted  system  are  shown  as  identical,  except 
that  the  adjusted  system  has  a  separate  feedback  path  through  the 
multiplier  (Figure  3).  This  is  equivalent  to  stating  that  the  constant 
a^  is  being  dithered,  and  is  at  its  equilibrium  value,  as  previously 
mentioned. 


Model  System 


Fig.  3.  Block  diagram  of  the  fast  system,  . 


Consider  now  a  portion  of  the  total  signal  appearing  at  point  A. 

Let  this  portion  of  the  total  signal  be  at  frequency  .  As  this  signal 

passes  through  the  system,  it  will  produce  a  correction  term  at  point 

A  which  will  be  at  the  same  frequency, 

This  correction  term  ,  produced  by  the  original  signal  at  co^,  is 

the  only  signal  in  the  system  which  is  coherent  with  the  original 
* 

term.  The  analysis  will  be  carried  out  on  the  basis  that  the  total 
output  of  the  squaring  device  can  be  represented  as  shown  in  Figure  4. 

Correction 

Terms 

- ^ . 

Original  Total 

Signal  Signal 

Fig.  4.  Block  diagram  of  the  analysis  method. 

Here  the  one  input  to  the  differential  is  that  part  of  the  signal  which 
would  exist  if  the  loop  were  opened  at  B  (Figure  3).  The  second  input 
is  the  correction  term  produced  by  the  original  component  after  the 
loop  is  closed.  Thus  the  output  is  the  total  signal  at  frequency  . 

If  the  phase  sensitive  detector  is  opened  at  point  B  (Figure  3)  , 

♦ 

There  are  in  fact  other  signals  present.  However,  those  signals  are 
not  at  the  frequency  and  do  not  add  coherently  and  are  therefore 
neglected  in  the  analysis  to  follow. 
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then  the  only  signal  at  point  C  is  that  due  to  the  product  of  the  dither 
and  the  output  of  the  adjusted  system.  Under  this  condition,  the  circuit 
can  be  opened  at  point  C  and  a  generator  inserted  having  an  output 

u  Y  ^  /j(nA  +  wi)t  j(nA  -wi,  )t\ 

<  ^gen=  2  V  ) 

n 

V  jnAt 

where  bi  is  the  amplitude  of  the  dither  and  the  summation  >  C^e 

n 

represents  the  output  of  the  adjusted  system .  Note  that  this  is  the 
same  approximation  which  was  used  in  Chapter  III  when  terms  involving 
bi  ^  were  dropped.  Since  bi  will  be  assumed  to  be  small  enough  so 
that  bi  terms  may  be  neglected,  this  is  equivalent  to  restricting  the 
above  signal  to  one  traversal  of  the  adjusted  system -multiplier  loop. 
This  assumption  will  be  preserved  with  the  circuit  closed  at  point  B. 
Consider  a  sigTial  at  point  A  having  the  form 


(5-3) 


jwait 

ai  e 


(The  notation  "a"  will  be  used  in  tracing  this  signal  through  the 
system.  )  At  the  output  of  the  phase  sensitive  detector, 


(5-4) 


Ma  M 


a**  =  ai 


(• 


j(wai+wi)t  j(wai 
!  +  e 


'J 


At  the  output  of  the  integrator, 


"a"  =  ai 


j(wai  +u)i  )t  j(wai  -  )t 

® - +  1 - 

j(uai+wi)  j(wai-wi) 


(5-5) 
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At  the  output  of  the  multiplier,  this  signal  is  equal  to 


(5-6) 


jKi 

aJ - 

+  - - 

j(“ai  -  “1  )  J 

Here  S  is  the  representation  for  the  output  signal  of  the  ad¬ 

justed  system  (Figure  3). 

Now  as  this  signal  combines  with  the  input  and  is  passed  through 
the  adjusted  system  block,  each  term  is  multiplied  by  a  gain  at  the 
appropriate  frequency.  Furthermore,  these  are  the  only  terms  which 
can  contribute  coherently  at  the  output  of  the  detector  to  the  original 
signal  at  frequency  .  The  sign  change  in  Eq.  (S-6)  is  a  result  of 
the  amplifier  and  necessary  for  system  stability. 

The  output  of  the  differential  (difference  in  outputs  of  the  two 
systems)  contains  only  the  terms  since  terms  due  to  the  input 
signal  and  at  input  signal  frequencies  exactly  cancel  at  equilibrium. 
Thus  the  signal  may  be  written 
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(5-7) 


"a"  =  bi  G  ^j(nA  +a,i)^ 

n 


j(nA  +  wi  )t 


j(nA  -  ui  )t 


>1  ^  G  ^j(n  A  -  u)i  )  ^ 

/  N  j(nA+fa)i  •HJaj)t 

^  Cn  ai  G  y  {nA  +  u^j  +  wi  )  j  * 


j  (<*>1  +  "ai ) 


I 


C„ai  G 


/  ^  j(nA+«aj  -wi)t 

^j(nA  +  fa>ai  -  tui )/  * _ 


n 


j  (“ai  "  “1 ) 


Note  that  the  latter  two  summation*  represent  only  that  portion  of  6 
due  to  a  single  term  in  the  output  of  the  square  law  detector  Finally 
consider  the  signal  as  it  is  passed  through  the  squaring  device.  Here 
only  those  terms  which  combine  and  produce  a  signal  at  frequency 
will  be  retained. 

To  find  these  terms,  it  is  necessary  in  each  of  the  products  that 
if  index  +n  is  used  on  one  term  of  the  product,  (-n)  muet  be  used  on 
the  other.  Therefore 


(5-8) 


,  VC.  .  ,1  a,  C(j(ni+.., +<.»,)) 

*-  /  - r: - 7 — ; - 

■  J  (‘^ai  +  ) 


ai  G(j(nA  -wi  ))  C^bi  e 

j  («  -  wi ) 
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Finally,  since  the  above  expression  represents  the  correction  terms, 
and  all  terms  are  at  frequency  ,  the  magnitudes  of  these  terms 
may  be  eqiiated  giving 


(5-9)  aio  -  bi  ai  ^ 


n 


[C_j^  G  (-jnA  -  jwi)  G  (  j  (nA  +wi  +Wai ) ) 
j  (“ai  +  "1  ) 


I 


[C_n  G  (-jnA  +  jwi  )  G  ( j  (nA  -  +  Wa^  ))  ] 

j  (wai  -  <*>1  ) 


=  ai 


where  ajo  is  the  uncorrected  magnitude  of  the  original  signal  and  ai 
the  first  order  approximation  to  the  total  magnitude.  Now  the  magni  - 
tude  of  ax  may  be  found,  assuming  that  the  expression  in  the  brackets 
above  is  a  transfer  function  and  solving  for  ai  from  Eq.  (  5-9) 


(5-10)  ai  =  aio  <1  +  bj 


^  G(-jnA-  jwi  )G(j  (nA  +wi  +  )) 

n _ 

j  (wai  +  “1  ) 

G  (-jnA  +  jwi  )G(j(nA  -wi  )) 
n 

j  (wai  -  "1 ) 


Furthermore,  stability  of  the  system  may  be  studied  by  considering 


the  homogeneous  equation 
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(5-11)  ai 


1+  bi  JJL 


G  ( -jn A  -  jWi )  G  (j  (n A  +  wj  +  )) 


V 


j  (w^i  +  «1  ) 


G(-jnA  +  jwj  )  G  (j  (nA -Wi  +  )) 


j  (Wgj  -  ) 


J 


and  making  an  equivalent  Nyquiet  plot  for  this  system.  In  general^ 
once  the  analysis  of  the  system  has  been  carried  to  the  point  of  Eq. 
(5-9)#  conventional  techniques  may  be  used  to  analyze  system  behavior. 
The  fact  that  an  infinite  summation  occurs  and  the  implication  that  a 
digital  computer  analysis  must#  in  general#  be  used#  does  not  alter 
the  fact  that  the  conventional  techniques  are  applicable.  Furthermore 
these  summations  can  be  converted  to  integral  form  and  in  theory 
these  integrals  can  be  evaluated  exactly.  However#  the  evaluation  is 
extremely  time-consuming  and  tedious. 

Finally#  it  should  be  pointed  out  that  if  noise  is  present  in  the 
system#  it  can  be  handeled  in  precisely  the  same  manner;  that  is#  one 
must  trace  each  component  as  it  traverses  the  system  and  then  sum 
these  to  find  their  total  effect.  If  it  is  desired  to  find  the  spectrum 
of  the  output  of  the  squaring  device#  this  too  can  be  approximated  by 
conventional  techniques  applied  to  the  signal  as  expressed  in  Eq.  (5-10)# 
and  iterations  based  upon  this  same  technique  will  improve  the  accuracy. 


CHAPTER  VI 


ANALOG  COMPUTER  SOLUTION 

This  chapter  is  the  description  of  an  analog  computer  solution  of 
the  problem  considered  in  Chapters  III  and  IV.  Figure  5  is  an  analog 
computer  diagram  of  the  system  under  observation.  The  variables 
are  indicated  on  this  computer  diagram.  To  augment  the  conclusions 
reached  in  ChaptersIIl  and  IV  >  four  separate  types  of  runs  were  made 
with  this  system.  First,  the  system  was  allowed  to  adapt  for  the  case 
that  5  (t)  at  t  =  0  was  a  small  positive  constant.  The  second  run  was 
for  the  case  6  (t)  at  t  =  0  equal  to  a  small  negative  constant.  Figures 
6  and  7  show  typical  response  curves  for  these  two  cases.  The  two 
curves  shown  on  each  figure  are  and  6(t)  versus  cycles  of  the 
dither  frequency. 

Figures  6  and  7  show  the  manner  in  which  &  (t)  is  adjusted  (ih  this 
case,  to  zero)  when  its  initial  value  is  small.  The  time  scale  here 
has  been  compressed  so  that  the  response  of  the  adaptive  system  may 
look  to  be  faster  than  it  really  is.  The  parameters  used  for  this  case 
were  ag  =  aj  =  az  =  1  ,  wi  =0.2  radians  per  second,  and  x(t)  a 
random  signal  with  average  frequency  of  about  1  cycle  per  second. 

Figure  8(a)  shows  the  results  in  the  case  when  the  same  system 
as  used  for  Figures  6  and  7  is  allowed  to  adjust  with  a  6  (t)  at  t  =  0 
equal  to  nearly  unity  (100  volts  is  one  machine  unit  on  the  analog 
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Fig.  5.  Analog  computer  block  diagram  of  slow  system. 
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computer).  It  is  significant  that  in  five  cycles  of  dither,  the  value  of 
6  (t)  is  not  significantly  changed.  This  experimental  observation  sup  ¬ 
ports  the  conclusion  reached  in  Chapter  III  that  when  6  (t)  is  initially 
large,  the  error  squared  (  g^i)  is  essentially  independent  of  6  (t).  If, 
by  chance,  through  saturation  of  analog  computer  components,  etc, 
the  value  of  6  (t)  decreases  to  some  value  that  is  small  (  |  6(t)|  « 

I  ~a.2  u*  +  j  ai  oj  +  a^  I ) ,  then  from  that  point  on,  6  (t)  will  approach 
zero  as  before. 

Figure  8  (b)  shows  the  behavior  of  6  (t)  if,  together  with  the  large 
initial  value  of  6  (t),  bi  ,  the  dither  amplitude  ,  is  increased  by  a 
factor  of  four.  The  effect  is  that  of  increasing  the  dither  to  the  point 
where  the  component  of  j  at  the  dither  frequency  is  now  signifi¬ 
cant  with  respect  to  the  total  error.  Note  that  in  this  case  the  value 
of  6  (t)  drops  to  a  small  value  during  the  first  cycle  of  dither  and 
thereafter  oscillates  about  zero  with  a  fairly  large  amplitude.  This 
is  a  result  of  the  fact  that  the  component  of  e*i  at  the  dither  fre¬ 
quency  is  now  much  larger  than  the  error  squared  term,  due  to  the 
input  signal  alone  ,  and  therefore  predominates  in  the  adaptive 
process.  Although  this  situation  has  served  to  demonstrate  a  result 
of  the  analysis  in  Chapters  III  and  IV,  it  is  not  satisfactory  in  general 
to  allow  the  amplitude  of  the  dither  to  be  large  with  respect  to  the 
input  signal. 

One  effective  means  of  treating  large  initial  values  of  6  (t)  is 


that  of  starting  the  adaptive  process  with  large  values  of  dither  and 
then  reducing  the  dither  amplitude  accordingly  as  5  (t)  approaches 
zero. 

To  verify  the  conclusion  made  earlier  that  for  large  initial 
values  of  error>  the  system  error  squared  is  independent  of  the 
value  of  6(t),  the  following  experiment  was  performed:  The  circuit 
was  opened  at  the  output  of  the  squaring  device  and  this  error  squared 
was  integrated  over  a  constant  time  interval  for  different  initial 
values  of  6  (t).  The  results  are  shown  in  graphical  form  in  Figure  9. 
Note  that  as  5  becomes  larger  than  2  (a  relative  value)  the  integral 
of  error  squared  does  in  fact  become  independent  of  the  amount  of 
errori  6,  This  substantiates  the  conclusion  reached  at  the  end  of 
Chapter  IV. 


CHAPTER  VII 


CONCLUSIONS 

The  material  presented  so  far  has  consisted  of  the  development 
of  analysis  methods  and  their  application  to  a  class  of  adaptive  control 
systems.  The  aniysis  of  the  slow  system  (Chapters  III  and  IV)  is 
relatively  easy  to  perform,  both  because  of  the  nature  of  the  system 
and  because  of  the  resulting  simplifications  which  can  be  made.  In 
the  analysis  of  the  fast  system,  however,  these  assumptions  are  not 
applicable,  and,  for  this  reason,  the  analysis  method  used  in  Chapter  V 
was  devised.  The  analysis  methods  presented  here  are  adequately 
suited  to  this  class  of  adaptive  control  systems  with  respect  to 
specifying  the  nature  of  the  error  signal  (the  performance  criterion). 
Once  this  error  signal  is  specified,  conventional  techniques  may  be 
used  to  evaluate  system  stability  and  performance. 

Adaptive  control  systems  have  many  varied  applications.  The 
slow  system  has  been  used  to  advantage  in  the  determination  of  human 
parameters.'^  Here  the  model  system  was  a  human  operator  and  the 
adjusted  system  was  an  analog  computer  representation  of  the  human 
operator.  The  adaptive  or  supervisory  loop  adjusted  the  parameters 
in  the  analog  computer  to  match  those  of  the  human,  thus,  in  effect, 

measuring  the  human  parameters.  In  an  application  of  the  fast 

14 

system  ,  radome  error  in  an  air-to-air  system  was 
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essentially  cancelled  by  an  adaptive  control  system  in  a  small 
fraction  of  the  flight  time  of  the  missile,  improving  missile  per¬ 
formance  greatly*  This  latter  application  does  not  belong  strictly 
to  the  class  studied  in  this  paper,  since  its  operation  is  dependent 
upon  a  sinusoidal  test  signal  at  the  system  input*  Although  both 
classes  of  adaptive  systems  have  many  applications,  it  is  felt  that  the 
class  considered  in  this  paper  is  more  versatile,  in  general.  Other 
examples  of  applications  of  adaptive  control  may  be  listed  as  follow^: 
The  fast  system  could  be  used  to  optimize  the  bandwidth  of  the  i-f 
section  of  a  receiver  based  upon  the  maximization  of  the  signal-to- 
noise  ratio.  Another  example,  which  is  in  use  at  the  present  time, 
is  an  adaptive  system  that  adjusts  the  gain  of  an  automatic  pilot 
system  as  a  function  of  altitude  and  other  environmental  factors* 
Again,  this  latter  application  belongs  to  the  class  of  systems  having 
external  test  signals  applied  to  the  input. 

Although  adaptive  control  systems  are  built  and  used  widely, 
there  is  still  little  known  about  synthesis  procedures.  The  most 
common  and  perhaps  the  best  synthesis  tool  today  is  the  analog 
computer  simulation.  As  systems  become  more  complex,  however, 
it  is  felt  tb.at  the  analog  computer  simulation  will  not  be  adequate  for 
systems  with  large  input  signals  or  large  parameter  errors.  It  has 
been  this  author's  experience  that  the  slow  system  simulation, 
discussed  in  Chapter  VII,  will  adapt  even  when  the  initial  value  of 
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the  gain  parameter  aQ+  6  (t)  is  negative.  This,  however,  may  be 
due  to  limiting  or  saturation  or  both  in  the  analog  computer,  and 
mathematical  techniques  to  handle  cases  of  this  type  would  certainly 
be  desirable.  When  adaptive  systems  were  first  considered,  it  was 
thought  by  many  that  all  the  problems  in  the  automatic  controls  field 
would  be  magically  solved.  However,  this  was  certainly  not  the  case; 
in  fact,  a  host  of  new  problems  arose.  Among  these  were  the  question 
of  stability  of  the  supervisory  loop,  the  effect  of  dither  signals  upon 
the  performance  of  the  primary  system,  and  others.  Futhermore, 
there  arose  the  question  of  specifying  a  performance  criterion  for 
adaptive  systems.  Although  the  supervisory  loop  operates  on  the  basis 
of  its  own  performance. criterion,  as  soon  as  the  system  is  in  equilibriun^ 
this  criterion  no  longer  exists.  With  this  in  mind,  it  is  thought  that 
the  hunting  loss  as  defined  in  the  introductory  paragraphs  of  Chapter  V 
is  an  adequate  criterion  by  which  the  performance  of  the  adaptive  system 
can  be  evaluated. 

As  more  is  learned  about  the  analysis  of  th  ese  adaptive  systems, 
it  is  felt  that  broad  synthesis  techniques  will  evolve.  Until  that  time, 
however,  the  analog  computer  must  be  used,  and  new  and  better  analysis 
techniques  must  be  developed. 


APPENDIX  I 


MATHEMATICS  OF  THE  PHASE  SENSITIVE  DETECTOR 


In  the  phase  sensitive  detector  (Chapters  III,  IV,  and  V)  the  two 
input  signals  Ei  and  E2  are  merely  multiplied  together  to  give  E^  . 
Here  Ej  is  the  square  of  a  signal  involving  frequencies  «,  w  +  Wi  , 
and  w  -  uj  .  Let  Ei  be  given  by 


(Al-l)  E,  =  (a,  e-i"'  +  a.,  a,  +  a.^ 


j(a)-wi)t  j(u-wi)t  2 

+  as  e  +  a-3  e*'  ) 


where  oji  «  co  .  Now  writing  Ei  at  length,  omitting  all  frequencies  of 
2cj  -  2wi  and  higher, 

-  jui  t  jwi  t 

(Al-2)  El  =  ai  a_i  +  ai  a_2  e  +  ai  a-3  e 

jwit  ^  -2jwit 

+  a_i  as  e  +  a-i  as  e  +  az  a-z  +a2  a.s  e 

-j2wi  t 

+  as  a_3  +  a_2  as  e 

If  this  signal  is  now  passed  through  the  phase  sensitive  detector,  the 

d.  c.  term  of  the  output  E^  will  be  given  by  the  d,  c.  part  of  the 

jwi  t  -  jwi  t 
product  of  El  and  (e  +e  ) 

(Al-3)  EQ(dc)  =  ai  a.z  +  ai  a.s  +  a_i  az  +  a_i  as  . 
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This  is  essentially  the  product  of  the  (u  -  ui)  frequency  terms  by 

the  (-w  +  wi)  terms^  which  is  exactly  the  product  formed  in  the  earlier 

±  jWjt 

chapters.  Thus,  it  is  valid  merely  to  drop  the  e  from  the 

signal  in  the  earlier  chapters  to  obtain  the  expression  for  the 
output  of  the  phase  sensitive  detector  since  in  the  notation  used  there/ 
both  positive  and  negative  frequencies,  corresponding  to  ±  u ,  are 


included. 
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SI 


If  one  divides  through  both  sides  of  the  above  by  2  7riA  s^  ,  then  it  is 
true  that 


(A2-3) 


r_JJlL_ds 

27Ti  J  (S  - 


Now  if  f(8)  is  analytic  within  the  contour  C,  the  left-hand  side  of  the 
above  equation  is  equal  to  (from  the  Cauchy  Integral  Theorem  * ) 


(A2-4)) 


^(•o  +  ^  *o)  -  ^(®o) 


and  the  limit  as  A  s^  0  of  the  above  is 


f  (•o  ^  *n)  ~  ^  (*0) 

(A2.5)  lim  I  _Lf - 2: - LZ  1  =  f'(«J  . 


ASo-*0 


A  8, 


But  the  right-hand  side  of  the  above  is  given  by 


27riZis„  J  8-S--AS-  s-s„/  Ztt  1  J  (s -s„ 


'O  V  'o  ""o 
C 


which  also  is  equal  to  (g^). 

It  remains  to  be  shown  that  the  approximation  is  valid  when  As^ 
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is  small  but  non-zero*  Consider  the  difference  between  the  two 
integrals 


(A2-7) 


1 


ZTTiAs, 


A  Sq  f (s) 


(s  -  So-As-){s  -  s_) 


ds 


2  TTi  J 


f  (s)  ds 

(s  - 


ds 


1  r  [  (s  -  So)-(s  -  Sq  -  ASq)]  f  (s)  ds 
2rri  J  (s  -  Sq)*  (s  -  Sq  -  ASq) 


The  right-hand  side  is  written  as 


(A2-8) 


ASq  r _ f  (a)  ds _ 

27Ti  J  (s-Sq)*  (s-So-ASq) 


If  M  is  the  maximum  value  of  f(s)  on  C  and  L  is  the  length  of 
C,  and  if  d^  is  the  shortest  distance  from  s^  to  C  and  if  |ASq|  <  d^  , 
then 

_ f(s)  ds _  ^  ML  IAsqI 

(s-Sq)2  (s-Sq-ASq)  dQ*  (dQ-  IaSqI) 

The  expression  on  the  right  is  linear  in  As^  and  therefore  goes  to 
zero  as  As^  “*0  .  Now  it  is  important  to  consider  the  case  in  which 
the  contour  C  encloses  a  pole  of  f(s).  It  is  necessary  to  show  the 
effect  of  the  deviation  As^  upon  an  integral  around  a  different 
contour  which  encloses  a  pole  of  f  (s)  but  not  s^  .  Now  it  must  be 


(A2-9) 


As. 


I 


shown  that 
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(A2-10)  - - - 

2  TTi  A  8 


If  f(s)  is  expanded  in  partial  fraction  form^  then  let  the  pole  which  is 
contained  in  c'be  s  s  si  .  Then  the  above  integral  may  be  written  as 


(A2.11)  ^  r  — i- 

277 1  J  ( 8  -  S 


(s  -  8j2  (8  -  81  ) 


d.  I 


ZttIA 


i— f  - ! - JllLd.  . 

J  I  8  -  8o  -  A  8^  a  -  8-81 


The  above  approximate  equation  is  evaluated  f  using  the  residue 
theorem  I  as 


(A2-12) 


g(8l)  ?  1 


1 


(81  -8„)*  ■  ASq  I  Si-Sq-ASj,  8i 


-r  g(8i) 
•  0^ 


or 


(A2-13) 


Finally 


1  ?  1 


As, 


(si  -sj*  Ab„  \  (bi  -Bo-A8j,)(8i  -Bq) 


(A2-14) 


(81  -8_)*  81*-  2bi  8_  +  B-*  -A8o(8i  -  Sq)  , 


and  since  jAs  is  small  with  respect  to  si  -  a  , 
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(A2-15) 


(■i 


(«i  -  Sq)^  -  ^ 


®o) 


Thus  the  two  expressions  are  nearly  equal . 

It  has  been  shown  that  the  approxinnation  made  in  Chapter  III  is  a 
valid  one  when  included  in  a  contour  integral,  first,  if  the  contour 
includes  only  the  pole  at  which  the  approximation  is  made  (s^)  and, 
second,  if  the  contour  includes  only  a  pole  of  f  (s).  Since  the  approxi¬ 
mation  is  valid  for  both  these  cases,  it  is  valid  for  any  arbitrary 
contour. 


APPENDIX  m 


NOTATION 


The  following  symbols  and  notation  arc  used  throughout 
this  paper 


3-1  ,  az  >  •  •  • 
bi 

Cl  ^  C2  >  C3  ^  .  .  . 


F  (s) 
f  (s) 

Go  (!<")  =  Go 
G  (jnA)  =  G 
G  ( j  (w  +  w  1  )  )  =  G^ 
G 

m  n  + 


k 1 ;  k2  J  k3  ^  ... 

M 

m,  n 


X 

y  1x1 
y 

X 

Y 

5 

11 

6 

e 


-  Constants  • 

-  Dither  signal  amplitude  • 

-  Constants  • 

-  Complex  representation  of  the  error  e  . 

-  A  function  of  the  complex  variable  s  • 

-  A  function  of  the  complex  variable  s  . 

-  Gain  of  the  model  system  for  input  of 
frequency  u>. 

-  Gain  of  the  adjusted  system  for  random 
input  "  (t)  . 

-  Gain  of  the  system  for  input  of  frequency 
ca  4-  lui  . 

-  Gain  of  the  system  for  input  frequency 
j[(m  +  n)  A  +  wi]  . 

-  Solution  of  the  integral  of  the  form  in 
Reference  3  . 

-  Constants  . 

-  A  constant  . 

-  Numbers  which  are  almost  but  not  quite 
equal  to  the  integers  [  m]  >  [  n]  . 

Normally  the  brackets  are  omitted  when 
these  numbers  are  used  as  integral  indices. 
The  ratio  of  any  two,  (e.g.,  m/n),  is  an 
irrational  number. 

-  A  random  input  of  the  form  x  = 

n 

-  Output  of  the  model  system  . 

-  Output  of  the  adjusted  system  . 

-  Input  expressed  in  complex  form  . 

-  Output  expressed  in  complex  form  . 

-  The  sum  over  the  infinite  range  of  the 
index  _  oc  <  n  <  »  . 

-  Small  deviation  of  a  parameter  about  its 
average  value  . 

-  System  error  ;  difference  between  outputs 
of  model  and  adjusted  system  . 


n 


jnAt 
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